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Video System 

BACKGROUND OF THE INVENTION 
Field Qf the Iny^ntipn 

The present invention relates to a video system 
for video telephones and video conferences using video 
cameras and the like. 
Related Background Art 

In recent years, along with the development of 
microprocessors which can realize high-speed arithmetic 
operations, personal computers, workstations, and the 
like for multimedia information can process a large 
volume of image information and audio information in 
real time. More specifically, personal computers and 
workstations can realize a device for reading out a 
full-color moving image signal, an audio signal, and 
the like from a CD-ROM, and reproducing these signals 
in association with each other, and a video conference 
or video telephone function of mainly achieving a 
conference such as a meeting by converting a moving 
image signal and an audio signal from a video camera 
into digital signals, and transmitting compressed 
digital signals to a remote station via a communication 
line. 

In the video telephone or video conference 
function utilizing a personal computer or workstation, 
a video camera is arranged on or near a monitor. 
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Recently, a system which can control the video camera 
in accordance with commands from the personal computer 
or workstation by a simple operation has been 
developed . 

5 However, when the video telephone or video 

conference function is realized using a combination of 
a personal computer or workstation with a video camera, 
different device driver software programs must be 
prepared and selectively used in correspondence with 

10 the sensor sizes and functions of video cameras, 

resulting in inconvenience for an operator. In order 
to detect a photographing range in direction or zoom 
control of the camera, the range must be confirmed by 
operating the camera to the limit of the direction or 

15 zoom control, and a cumbersome operation is required 

for displaying a required image on a monitor, resulting 
in poor operability. Furthermore, in the video 
conference or video telephone function, since the 
direction and zooming of the camera can be controlled 

20 by the remote station side, an image including contents 
which are not to be disclosed to a third party is 
undesirably transmitted to the remote station, thus 
posing a problem associated with protection of privacy. 

25 SUMMARY OF THE INVENTION 



It is an object of the present invention to 
provide a video system which can solve the 
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above-mentioned problems, and is easy to use. 

It is another object of the present invention to 
provide a video system with high operability. 

It is still another object of the present 
5 invention to provide a video system which can obtain a 
required image. 

In order to achieve the above objects, according 
to one aspect of the present invention, an optical 
image is converted into a video signal by an image 

10 pickup means, the image pickup direction of the image 
pickup means is changed by an image pickup direction 
changing means, the video signal output from the image 
pickup means is displayed on an image display means, 
and function information of the image pickup means is 

15 displayed on a function information display means. 

With this arrangement, the image pickup direction of 
the image pickup means can be freely changed by the 
receiving station side, and a video system which is 
very easy to use can be provided. Since the function 

20 information of the image pickup means is displayed, an 
operator can recognize functions at a glance, and need 
not operate the image pickup means to confirm the 
functions. 

According to another aspect of the present 
25 invention, an optical image is converted into a video 
signal by an image pickup means, the image pickup 
direction of the image pickup means is changed by an 
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image pickup direction changing means, "the video signal 
output from the image pickup means is stored as a still 
image in a still image storage means, the image pickup 
direction of the image pickup means upon photographing 
5 of the still image is stored in a photographing 

direction storage means, the still image stored in the 
still image storage means is displayed on a still image 
display means, a moving image output from the image 
pickup means is displayed on a moving image display 

10 means, the position on the still image displayed on the 
still image display means is designated by a 
designation means, and the photographing direction 
change means is controlled, so that the position 
designated by the designation means becomes a 

15 predetermined position of an image. With this 

arrangement, the image pickup direction of the image 
pickup means can be freely changed by the receiving 
station side, and control is made, so that the 
designated position on the stored still image becomes a 

20 predetermined position of an image. For this reason, a 
video system which is convenient and allows a simple 
operation can be provided. 

According to still another aspect of the present 
invention, an optical image is converted into a video 

25 signal by an image pickup means, the image pickup 

direction of the image pickup means is changed by an 
image pickup direction changing means, a video signal 
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within a photographable range of the image pickup 
direction changing means is stored, and the stored 
video signal is displayed. With this arrangement, the 
image pickup direction can be freely changed by the 
5 receiving station side, and an image within the stored 
photographable range is displayed. For this reason, 
since an operator can know the photographable range at 
a glance, a very efficient video system can be 
provided . 

10 Other objects and features of the present 

invention will become apparent from the following 
specification and the accompanying drawings. 
BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram showing the arrangement 

15 of the entire control apparatus for an image input 

device according to the first embodiment of the present 
invention; 

Fig. 2 is a block diagram showing the arrangement 
of an image synthesization circuit; 
20 Fig. 3 is a schematic diagram showing the 

arrangement of a video camera; 

Fig. 4 is a diagram showing a state wherein video 
cameras are connected to the control apparatus; 

Fig. 5 is a view showing a state wherein images of 
25 objects are picked up by the video camera and are 
displayed on a monitor; 
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Figs. 6A and 6B are views showing the positional 
relationship between moving images on a display picture 
and objects; 

Fig. 7 is a view showing the relationship between 
5 the focal length of a lens and the photographable angle 
of view of a CCD; 

Fig. 8 is a table showing control commands for 
controlling various operations; 

Fig. 9 is a table showing the status format of the 
10 video camera; 

Fig. 10 is a table showing the function 
information format of the video camera; 

Fig. 11 is a flow chart showing the control 
sequence of the first embodiment; 
15 Fig. 12 is a flow chart showing the control 

sequence of the first embodiment; 

Fig. 13 is a flow chart showing the control 
sequence of the first embodiment; 

Fig. 14 is a block diagram showing the arrangement 
20 of an image synthesization circuit as the second 

embodiment of a control apparatus for a video camera 
according to the present invention; 

Fig. 15 is a table showing an example of data 
stored in a still image storing unit of the image 
25 synthesization circuit; 
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Fig. 16 is a view showing a state wherein both a 
still image and a moving image are displayed on a 
display picture; 

Figs. 17A and 17B are views showing the positional 
5 relationship between a display on a moving image region 
and objects at that time; 

Figs. 18A and 18B are views showing a display on 
the moving image region and the direction of the video 
camera at that time; 
10 Figs. 19A and 19B are views showing a display on 

the moving image region and the direction of the video 
camera upon completion of direction control of the 
video camera; 

Fig. 20 is a flow chart showing the control 
15 sequence of the second embodiment; 

Fig. 21 is a flow chart showing the control 
sequence of the second embodiment; 

Fig. 22 is a flow chart showing the control 
sequence of the second embodiment; 
20 Fig. 23 is a flow chart showing the control 

sequence of the second embodiment; 

Fig. 24 is a block diagram showing the arrangement 
of a control apparatus for a video camera according to 
the third embodiment of the present invention; 
25 Fig. 25 is a view showing a state wherein both a 

still image and a moving image are displayed on a 
display picture in the third embodiment; 
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Fig. 26 is a block diagram showing the arrangement 
according to the fourth embodiment of the present 
invention; 

Fig. 27 is a view illustrating a video conference; 
5 Fig. 28 is a view showing a monitor screen during 

the video conference; 

Fig. 29 is a perspective view showing pan and tilt 
drive systems; 

Fig. 30 is a plan view for explaining pan 
10 movement; 

Fig. 31 is a plan view for explaining pan 
movement ; 

Fig. 32 is a plan view for explaining pan 
movement ; 

15 Fig. 33 is a plan view for explaining pan 

movement ; 

Fig. 34 is a side view for explaining tilt 
movement ; 

Fig. 35 is a view showing an example of the entire 
20 display of all images within a photographing range; 

Fig. 36 is a block diagram showing the circuit 
arrangement of an image storing unit; 

Fig. 37 is a flow chart showing the operation of 
the fourth embodiment; 
25 Fig. 38 is a flow chart showing the operation of 

the fourth embodiment; 
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Fig. 39 is a flow chart showing the operation of 
the fourth embodiment; 

Fig. 40 is a flow chart showing the operation of 
the fourth embodiment; 
5 Fig. 41 is a flow chart showing the operation of 

the fourth embodiment; 

Fig. 42 is a flow chart showing the operation of 
the fourth embodiment; 

Fig. 43 is a view showing an example of setting of 
10 a photographing prohibition image; 

Fig. 44 is a view showing the relationship between 
the focal length of a lens and the angle of view; 

Fig. 45 is a block diagram showing the arrangement 
according to the fifth embodiment of the present 
1 5 invention ; 

Fig. 46 is a circuit diagram of a video image 
superimposing circuit having a function of an image 
storing device; 

Fig. 47 is a view showing an example of the entire 
20 display of photographing range images without 
boundaries; and 

Fig. 48 is a table showing the transmission format 
of camera control commands. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 
25 The preferred embodiments of the present invention 

will be described in detail below with reference to the 
accompanying drawings. 
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Fig. 1 is a block diagram showing the first 
embodiment of a control apparatus for a video camera, 
which is applied to a video system according to the 
present invention, and a control apparatus 1 has the 
5 following arrangement. That is, a storage unit 2 which 
comprises a ROM for storing a control program and the 
like and a RAM for temporarily storing various data 
during a control operation, a DMA (Direct Memory 
Access) controller 3, an FD controller 5 for 

10 controlling a flexible disk 4, and an HD controller 7 
for controlling a hard disk 6 are connected to a CPU 
(central processing unit) 9 via an address/data bus 8 
(to be referred to as a "bus" hereinafter). The CPU 9 
is connected to a video signal display image 

15 synthesization circuit 10 (to be referred to as an 

"image synthesization circuit" hereinafter) via the bus 
8, and the image synthesization circuit 10 is connected 
to a monitor 11 and a plurality of video cameras 13. 
More specifically, the image synthesization circuit 10 

20 performs predetermined display processing on the basis 
of a video signal from each video camera 13, and 
outputs the video signal to the monitor 11. 
Furthermore, the CPU 9 is connected to an interface 
controller 12 via the bus 8, and the interface 

25 controller 12 is connected to the plurality of video 
cameras 13. These video cameras 13 and the interface 
controller 12 can perform bidirectional 
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transmission/reception of control commands 
therebetween. More specifically, the interface 
controller 12 generates a transmission request signal 
for requesting transmission of, e.g., function 
5 information of each video camera 13. On the other 

hand, the video cameras 13 transmit control commands 
such as function information to the interface 
controller 12 in response to the transmission request 
signal, and supply predetermined video signals to the 

10 image synthesization circuit 10. The CPU 9 is 

connected to a position storing unit 14 and a mouse 
controller 16 via the bus 8. The position storing unit 
14 stores position information of each video camera 13 
corresponding to an image displayed on the monitor 11. 

15 The mouse controller 16 is connected to a pointing 

device such as a mouse 15, and controls its operation. 

The image synthesization circuit 10 has an 
arrangement, as shown in detail in Fig. 2. A 
superimposing controller 17 is connected to the bus 8 

20 via a data signal line L0, a control signal line LI, 

and a position information line L2 to execute an image 
synthesization operation. The data signal line L0 is 
connected to a buffer 18, and the position information 
line L2 is connected to a pointing position recognizing 

25 circuit 19 for recognizing the pointing position on a 
picture or screen. 
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The data signal line LO and the control signal 
line LI are connected to a mouse cursor generation 
circuit 20 for generating a mouse cursor, and a bus 
interface 21 for performing an interface operation with 
5 the bus 8. Furthermore, the mouse cursor generation 

circuit 20 and the bus interface 21 are connected to a 
VGA (Video Graphics Array) display signal generating 
circuit 22 for outputting a VGA display signal, and the 
VGA display signal generating circuit 22 is connected 

10 to a display timing generation circuit 23 for setting a 
display timing, a DRAM (dynamic random access memory) 
24, the pointing position recognizing circuit 19, and 
the superimposing controller 17. 

On the other hand, an A/D converter 25 which 

15 receives a video signal from each video camera 13 is 
connected to a digital video decoder 26 for decoding 
the video signal. The digital video decoder 26 is 
connected to a mirror image conversion circuit 27 for 
performing mirror image conversion. The mirror image 

20 conversion circuit 27 horizontally reverses a video 

signal, and displays an image on the monitor 11 as if 
the image were reflected in a mirror. More 
specifically, the mirror image conversion circuit 27 
writes an input video signal for one line in, e.g., a 

25 line memory in the input order, and reads out the 
information written one line before in the reverse 
direction at the timing of the next line. Then, a 



- 13 - 



current input signal is written at the readout address, 
thus achieving full-line mirror image reversal. 

The mirror image conversion circuit 27 is 
connected to the superimposing controller 17. The 
superimposing controller 17 is connected to a TTL 
(Transistor Transistor Logic) switch circuit 28, which 
performs logic processing of a signal, directly or via 
a VRAM (video random access memory) 29. Furthermore, 
the TTL switch circuit 28 is connected to a D/A 
converter 30 . 

The A/D converter 25, the digital video decoder 
26, the mirror image conversion circuit 27, and the 
superimposing controller 17 are connected to a PLL 
(Phase-locked loop) circuit 31, and the VGA display 
signal generating circuit 22 is connected to the TTL 
switch circuit 28 via a color palette 32. 

In the image synthesization circuit 10, an analog 
video signal input from each video camera 13 is 
converted into a digital signal via the A/D converter 
25, and the digital signal is decoded by the digital 
video decoder 26, thus generating RGB (Red, Green, and 
Blue) signals. The RGB video signals are input to the 
mirror image conversion circuit 27 and are subjected to 
mirror image conversion. Thereafter, the RGB signals 
are input to the superimposing controller 17. Then, 
the RGB video signals are temporarily stored in the 
VRAM 29, and are read out in synchronism with. the VGA 
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display signal generating circuit 22 . The readout RGB 
signals are synthesized with a VGA signal by the TTL 
switch circuit 28, and the synthesized composite 
signals are converted by the D/A converter 30 into an 
analog signal . The converted analog signal is output 
to the monitor 11 as a video signal. More 
specifically, the VRAM 29 constantly stores input video 
signals, and the video signals are read out 
asynchronously with the storage operation but 
synchronously with the VGA display signal generating 
circuit 22. 

Fig. 3 is a schematic diagram showing a drive 
device and circuit for each video camera 13. Each 
video camera 13 comprises a stationary portion 33 and a 
movable portion 34. The movable portion 34 is attached 
to the stationary portion 33 to be movable in the pan 
and tilt directions. 

More specifically, the stationary portion 33 
incorporates a drive device for rotating the video 
camera 13 in the pan and tilt directions, a control 
circuit for controlling the drive device, and a video 
circuit for outputting a video signal . 

The drive device comprises, as major components, a 
pan cogwheel 39 for rotating the movable portion 34 in 
the pan direction (indicated by an arrow A in Fig. 3) 
via a pan shaft 38, a pan control motor 40 for 
transmitting the drive force to the pan cogwheel 39, a 
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tilt cogwheel 41 for rotating the movable portion 34 in 
the tilt direction (indicated by an arrow B in Fig. 3) 
via a tilt shaft (not shown), and a tilt control motor 
42 for transmitting the drive force to the tilt 
5 cogwheel 41 . 

The control circuit comprises an external 
interface circuit 43 for performing an interface 
operation with the control apparatus, an operation 
processing unit 44, and an input/output (I/O) port 45 

10 for supplying control signals to the pan control motor 
40 and the tilt control motor 42 in accordance with the 
operation result of the operation processing unit 44. 

Furthermore, the video circuit comprises a process 
circuit 46 for, e.g., separating an output signal from 

15 the movable portion 34 into a luminance signal Y and a 
chrominance signal C, and a video encoder circuit 47 
for outputting a predetermined video signal . 

On the other hand, the movable portion 34 
comprises a lens 48, a zoom lens 49, a zoom control 

20 circuit 50 for controlling the zoom lens 49, an iris 

51, an iris control circuit 52 for controlling the iris 
51, a CCD 53 for converting an optical image of an 
object into an electrical signal, and a CCD read-out 
circuit 54 for reading out an electrical signal 

25 converted by the CCD 53 and transmitting the readout 
signal to the process circuit 46. 
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In the video camera, "the zoom position is set by 
the zoom control circuit 50 and the iris is set by the 
iris control circuit 52. An optical image of an object 
is formed on the CCD 53 via the lens 48 and the zoom 
5 lens 49, and is photoelectrically converted into a 

video signal . The video signal is output from a video 
terminal tl via the process circuit 46 and the video 
encoder circuit 47. Also, a control signal is input 
from a control terminal t2 to the pan control motor 40 

10 and the tilt control motor 42 via the external 

interface circuit 43, the operation processing unit 44, 
and the I/O port 45 so as to attain rotation control in 
the pan and tilt directions. 

Fig. 4 shows a state wherein various video cameras 

15 13a to 13e to be controlled are connected to the 

control apparatus 1. In Fig. 4, various video cameras 
13a to 13e having different sensor sizes and operation 
functions are connected to the control apparatus 1 via 
a switch 55. More specifically, the switch 55 has 

20 terminals 56a to 56e, and one of the terminals 56a to 
56e is selected by a switching control signal 57 from 
the control apparatus 1. One of the video cameras 13a 
to 13e connected to the selected terminal exchanges 
signals with the control apparatus 1 via a signal line 

25 57'. 

More specifically, the terminal 56a is connected 
to a video camera 13a which comprises a 1" CCD sensor 
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as an image pickup unit 58a, and has pan and tilt: 
functions, and the terminal 56b is connected to a video 
camera 13b which comprises a 2/3" CCD sensor as an 
image pickup unit 58b and has pan and tilt functions. 
5 The terminal 56c is connected to a video camera 13c 
which comprises a 1/2" CCD sensor as an image pickup 
unit 58c and has only a pan function, and the terminal 
56d is connected to a head- separated fixed camera 13d 
which comprises a 1/3" CCD sensor as an image pickup 

10 unit 58d. Furthermore, the terminal 56e is connected 
to a hi-vision video camera 13e which comprises a 1" 
CCD sensor as an image pickup unit 58e. Note that the 
present invention is not limited to the above-mentioned 
video cameras 13 connected to the terminals 56a to 56e, 

15 and video cameras 13 having arbitrary sensor sizes can 
be connected to these terminals. 

Fig. 5 shows a state wherein object persons A, B, 
and C are photographed by the video camera 13a, and 
their images are displayed on a display picture 59. An 

20 iris control cursor 60, a pan control cursor 61, a zoom 
control cursor 62, and a tilt control cursor 63 are 
respectively arranged at the upper, lower, left, and 
right positions on the display picture 59* By 
designating the iris control cursor 60, the iris 

25 control circuit 52 is driven to control the brightness 
on the display picture 59- When an auto iris mode is 
set, iris data included in status information from the 
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video camera 13 is received to control the iris control 
cursor 60. On the other hand, by designating the zoom 
control cursor 62, the zoom lens 49 is moved via the 
zoom control circuit 50. An operator M operates the 
mouse 15 while observing the monitor 11 to perform 
display control of object persons on the display 
picture 59. Note that a mouse cursor 15a is generated 
by the mouse cursor generation circuit 20 upon 
operation of the mouse 15. 

In Fig. 5, the video camera 13a is operated to 
display the object person B at the central position of 
the display picture 59 at the present time. For 
example, the video camera 13a can be remote-controlled 
to display the object person A at the central position 
of the display picture. 

The control method will be described below with 
reference to Figs . 6A to 7 . 

Fig. 6A shows object persons displayed on the 
display picture 59 of the monitor 11. In Fig. 6A, the 
distance between the object persons A and B on the 
display picture 59 is £, and the horizontal distance of 
the display picture 59 is L. Fig. 6B is a plan view of 
a photographing room. In Fig. 6B, the moving angle of 
the video camera 13a required for displaying the object 
person A at the central position of the display picture 
59 is 9. Fig. 7 shows the relationship between a focal 
length f of the lens 48 and a photographable angle W of 
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view of the CCD 53* Referring to Fig. 7, if the 
horizontal effective distance of the CCD 53 is 
represented by X, a distance <j> between the object 
persons A and B on the CCD 53, the moving angle 9 of 
5 the video camera 13a, and the angle W of view are 

respectively given by the following equations (1) to 
(3): 

4> « X- l/L . . •(!) 

6 = tan^tj) . . . ( 2 ) 

10 W = 2tan- 1 (X/2f) ..-(3) 

As can be understood from equation ( 1 ) , the 
horizontal effective distance X of the CCD 53 is 
required for calculating the moving angle 0 in the pan 
direction, and similarly, a vertical effective distance 

15 Y (not shown) of the CCD 53 is required for calculating 
the moving angle in the tilt direction. 

Therefore, when an operator operates to 
sequentially switch the plurality of video cameras 13a 
to 13e having CCDs 53 of different sizes and to direct 

20 one of the video cameras 13 in the target object 
direction, by grasping the horizontal effective 
distances X and the vertical effective distances Y of 
the CCDs 53 used in the video cameras 13a to 13e, the 
control apparatus 1 can generate drive commands to the 

25 pan control motor 40 and the tilt control motor 42 to 
set a moving angle 0 suited for one of the video 
cameras 13a to 13e as an apparatus to be controlled. 
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Therefore, the operator M can easily perforin operation 
regardless of the types of the video cameras 13a to 
13e. 

The distance £ on the display picture 59 and the 
horizontal distance L of the display picture 59 are 
read out from the superimposing controller 17 and the 
pointing position recognizing circuit 19 via the bus 8 
in correspondence with the display storage amount of 
the VGA display signal generation circuit 22 ( see 
Fig. 2), and are used by the CPU 9 of the control 
apparatus 1 to calculate equation ( 2 ) . 

Fig. 8 is a table showing a control command system 
which is generated by the control apparatus 1 to each 
video camera 13. The table has addresses associated 
with apparatuses to be controlled (the video cameras 
13a to 13e) and the kinds of operation commands (focus 
setting, iris setting, zoom setting, rotational 
direction setting, and the like), and each control 
command is transmitted from the interface controller 12 
to each video camera 13. Note that control commands 
associated with pan and tilt movements are controlled 
by utilizing U x (X = 0 to 6), as can be seen from 
operation commands shown in Fig. 8. 

Fig. 9 is a table showing the status format of 
each video camera 13. In a status code, one of MO 
indicating "operation finished" and Ml indicating "now 
operating" is stored. Status information from each 
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video camera is sequentially transmitted from the 
external interface circuit 43 of each video camera 13 
to the interface controller 12 of the control apparatus 
1 in the order of a camera apparatus number, 
5 information kind code (CA), and status code. 

Fig. 10 is a table showing the function format of 
each video camera 13. Function information from each 
video camera 13 is sequentially transmitted from its 
external interface circuit 43 to the interface 

10 controller 12 of the control apparatus 1 in the order 
of a camera apparatus number, information kind code 
(CA), sensor size, horizontal moving range angle, 
vertical moving range angle, and video signal form, and 
the moving angle 6 of the video camera 13 is calculated 

15 on the basis of equations (1) to (3) above. 

The control sequence of the control apparatus of 
this embodiment will be described in detail below with 
reference to the flow charts in Figs. 11 to 13 and 
Fig. 4. 

20 The power switches of the video cameras 13a to 13e 

and the control apparatus 1 are turned on to start a 
control software program (step SI). A counter m of the 
switch 55 is set to be 1, and a selection number n of 
the input video camera is set to be 1 ( step S2 ) . When 

25 the counter m of the switch 55 is set to be "1", the 
terminal 56a serves as a video and operation control 
line; when the counter m of the switch 55 is set to be 
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,, 2 ,, , the terminal 56b serves as a video and operation 
control line; when the counter m of the switch 55 is 
set to be "3", the terminal 56c serves as a video and 
operation control line; and the same applies to other 
terminals. On the other hand, when the selection 
number n of the video camera is set to be " 1" , the 
video camera 13a becomes an apparatus to be controlled; 
when the selection number n of the video camera is set 
to be "2", the video camera 13b becomes an apparatus to 
be controlled; when the selection number n of the video 
camera is set to be "3", the video camera 13c becomes 
an apparatus to be controlled; and the same applies to 
other video cameras . 

In step S3, the switch 55 is connected to the 
video and operation control line m of the video camera 
n. 

An initialization command (10) is supplied via the 
external interface circuit 43 (Fig. 3) of the video 
camera 13 to set the direction of the video camera to 
have the pan angle = 0 and the tilt angle = 0 ( step 
S4). Note that leaf switches (not shown) are 
respectively attached to the positions corresponding to 
the pan and tilt angles =0, a pan maximum moving 
position, and a tilt maximum moving position. When the 
pan control motor 40 and the tilt control motor 42 are 
driven and these leaf switches are turned on, the 
operation processing unit 44 recognizes an absolute 
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position. The pan control motor 40 and the tilt 
control motor 42 are driven from this recognized 
position to set the movable portion 34 at an initial 
position. 

5 The control apparatus 1 supplies a status signal 

return command (TO) to the video camera 13 via the 
external interface circuit 43 (step S5 ) , and checks in 
step S6 if initialization is completed. When 
initialization is not completed, the video camera 13 

10 sends a status code Ml indicating "now operating" to 

the control apparatus 1, and the control apparatus 1 is 
set in a standby state. When initialization is 
completed, the video camera 13 sends back an operation 
end status code MO to the control apparatus 1, and the 

15 flow advances to step S7. At this time, the control 
apparatus 1 causes the monitor 11 to display a camera 
view icon of the video camera 13a to inform to an 
operator that the video camera 13a is operable. 

In step S7, a camera function request command (Tl) 

20 is supplied from the interface controller 12 to the 
video camera 13a. It is then checked if camera 
function information is sent to the control apparatus 
1. When the camera function information is not sent 
yet, the control apparatus 1 waits for a predetermined 

25 period of time until the information is sent ( step S8 ) . 
This wait time is counted by a timer, and when the 
above-mentioned function information (see Fig. 10) is 
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sent during the count operation of the timer, the flow 
advances to step S9 in Fig. 12 to store the received 
function information in the storage unit 2 in the 
control apparatus 1. Furthermore, a view icon 
5 corresponding to the function of the video camera 13a 
is displayed on the monitor 11. 

The flow then advances to step S10 to increment 
the counter m of the switch 55 and the selection number 
n of the video camera by "1" to switch the switch 55, 

10 and it is checked if the functions of all the video 
cameras are read (step Sll). 

If the functions of all the cameras are not read 
yet, the flow returns to step S3 to repeat the 
processing in steps S3 to S10; otherwise, it is checked 

15 if the view icon of the video camera 13a is 

double-clicked by the mouse 15 (step S12). If NO in 
step S12, the flow advances to step S15 (Fig. 13); 
otherwise, a command for displaying a video image on 
the display picture 59 is supplied to the superimposing 

20 controller 17 via the bus 8 (step S13), thereby 

displaying an image on the display picture 59 ( step 
S14). 

The read-out operations of the function 
information can be similarly performed for the 
25 remaining video cameras 13b to 13e. On the other hand, 
if the reception timer of the status information and 
the function information reaches a time-out state in 



- 25 - 

step S8, it is determined that the corresponding video 
camera has no movable portion. More specifically, a 
video camera which causes a time-out state has neither 
the pan function nor the tilt function. 
5 It is checked in step SI 5 if the pan control 

cursor 61 is designated. If NO in step S15, the flow 
advances to step SI 7; otherwise, the moving angle 9, in 
the pan direction, of the video camera 13a is 
calculated in correspondence with the absolute position 
10 of the pan control cursor 61, and an absolute moving 
angle is supplied from the interface controller 12 to 
the video camera 13a using a U5+ extension to change 
the angle (step S16). Thereafter, the flow jumps to 
step S23. 

15 Similarly, it is checked in step S17 if the tilt 

control cursor 63 is designated. If NO in step S17, 
the flow advances to step S19; otherwise, the moving 
angle 0, in the tilt direction, of the video camera 13a 
is calculated in correspondence with the absolute 

20 position of the tilt control cursor 63, and an absolute 
moving angle is supplied from the interface controller 
12 to the video camera 13a using a U6+ extension to 
change the angle (step S18). Thereafter, the flow 
jumps to step S23. 

25 Similarly, it is checked in step S19 if the iris 

control cursor 60 is designated. If NO in step S19, 
the flow advances to step S21; otherwise, the iris 
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amount of the video camera 13a is calculated in 
correspondence with the absolute position of the iris 
control cursor 60, and an absolute iris value is 
supplied from the interface controller 12 to the video 
5 camera 13a using a E5+ extension (step S20 ) . 

Thereafter, the flow jumps to step S23. More 
specifically, the iris full open position corresponds 
to the leftmost position of the cursor, the iris full 
stop-down position corresponds to the rightmost 

10 position of the cursor, and an intermediate iris 

position is proportionally allocated in correspondence 
with each different cursor position. 

Similarly, it is checked in step S21 if the zoom 
control cursor 62 is designated. If NO in step S21, 

15 the flow returns to step SI 2; otherwise, the zoom 
amount of the video camera 13a is calculated in 
correspondence with the absolute position of the zoom 
control cursor 62, and an absolute zoom value is 
supplied from the interface controller 12 to the video 

20 camera 13a using a Z5+ extension (step S22). 

Thereafter, the flow jumps to step S23. More 
specifically, the interval between maximum and minimum 
zoom positions is proportionally allocated in 
correspondence with different positions of the zoom 

25 control cursor 62 as in the control of the iris control 
cursor 60. 



- 27 - 



In step S23, a status signal return request 
command (TO) is sent from the interface controller 12 
to the video camera 13a to check the execution state of 
the above-mentioned camera operation control command, 
and it is then checked if a status signal indicating 
completion of execution of the command is returned 
(step S24). More specifically, the control waits for 
input of a status signal indicating completion of 
execution of the command from the video camera, and 
when execution of the command is completed, the flow 
returns to step Sll to continue the processing. By 
switching the switch 55, the above-mentioned operation 
is similarly performed for the remaining video cameras 
13b to 13e. 

In this manner, after the power switches of the 
video cameras 13a to 13e are turned on, the function 
information such as the size of the CCD 53, the 
pan/ tilt movable range, and the like of each of the 
video cameras 13a to 13e is supplied to the control 
apparatus, and the operations of the plurality of video 
cameras 13a to 13e can be controlled in accordance with 
the function information. For this reason, a 
man-machine interface corresponding to the functions of 
the video cameras 13 can be constituted. More 
specifically, when the video cameras 13a to 13e have 
different function information, the operator M need not 
switch a device driver software program in 
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correspondence with the video cameras 13a to 13e to 
execute control, thus improving convenience. The load 
on the operator is reduced, and the operator can 
accurately and efficiently control the photographing 
operations of various video cameras by a simple 
operation while observing the display picture 59 on the 
monitor 11. 

Fig. 14 is a block diagram showing an image 
synthesization circuit 10 as the second embodiment of a 
control apparatus according to the present invention. 
The same reference numerals in Fig. 14 denote the same 
parts as in Fig. 2, and a detailed description thereof 
will be omitted. In Fig. 14, a still image storing 
unit 64 for storing a video signal output from each of 
the video cameras 13a to 13e as a still image is added. 
More specifically, the still image storing unit 64 is 
connected to the A/D converter 25, the digital video 
decoder 26, the PLL circuit 31, the mirror image 
conversion circuit 27, the superimposing controller 17, 
and the TTL switch 28. The storing unit 64 receives a 
video signal output from each of the video cameras 13a 
to 13e, and also receives a control signal from each 
video camera 13 via the interface controller 12, the 
bus 8, and the superimposing controller 17. More 
specifically, as shown in Fig. 15, the still image 
storing unit 64 sequentially stores position 
information signals indicating a pan angle (+a), a tilt 
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angle (0), a zoom angle of view (Wl), and the like 
which are input in this order from each video camera 
13. 

In the second embodiment, as shown in Fig. 16, the 
5 monitor 11 has a still image trigger key 65 and a still 
image display picture 66 in addition to the moving 
image display picture 59 for displaying a moving image 
picked up by the video camera. The still image display 
picture 66 displays a still image which is read out 

10 upon operation of the still image trigger key 65. 

Figs. 17A and 17B show the positional relationship 
between an image displayed on the still image display 
picture 66 upon operation of the still image trigger 
key 65, and object persons at that time. Fig. 17A 

15 shows the still image, and Fig. 17B is a plan view of a 
photographing room. 

More specifically, after the power switch of the 
video camera 13a is turned on and the video camera 13a 
is initialized, the direction of the video camera 13a 

20 is set at an initialize position I. When the pan 

control cursor 61 is dragged by operating the mouse 15 
and the still image trigger key 65 is clicked at a 
position rotated by (+a) in the pan direction, the 
image shown in Fig. 17A is stored in the still image 

25 storing unit 64. More specifically, the still image 
storing unit 64 stores position information signals 
indicating the pan angle (+a), the tilt angle (0), the 
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zoom angle of view (Wl), and the like in this order, as 
described above. When the video camera 13a is rotated 
by (r\ - a) in the pan direction by moving the pan 
control cursor 61 and the zoom control cursor 62 so as 
to be directed in the direction of an object person B, 
as shown in Fig. 18B, the zoom angle of view changes 
from the angle Wl of view to an angle W2 of view, and 
this change amount is stored in the storage unit 2. 

When an object person A is zoomed up from this 
camera position while maintaining the zoom angle W2 of 
view, the pan control cursor 60 and the like may be 
moved by controlling the mouse 15 as in a case wherein 
the object person B is displayed at the central 
position. However, if the cursor is moved each time 
the direction of the video camera is changed, this 
results in a cumbersome operation and a heavy load on 
an operator especially in, e.g., a video conference in 
which different persons speak by turns. Thus, in this 
embodiment, as shown in Fig. 18A, the mouse 15 is 
clicked in a state wherein the object person A is 
zoomed up and the mouse cursor 15a is maintained at a 
position shown in Fig. 16 so as to realize direction 
control of the video camera toward the still object 
person A. Similarly, as shown in Fig. 19B, when the 
video camera 13a is rotated by -(r| + p) from the 
current position in the pan direction, the video camera 
13a can be direction-controlled toward the object 
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person C. Similarly, when a camera movement in the 
tilt direction is to be attained, the video camera can 
be controlled to a target position by designating an 
upper or lower position of the still image display 
5 picture 66. 

Figs. 20 to 23 are flow charts showing the control 
sequence of the second embodiment. 

The power switches of the video camera 13a and the 
control apparatus 1 are turned on (steps S31 and S32 ) . 

10 The control apparatus 1 supplies an initialization 

command ( 10 ) to the video camera 13a via the external 
interface circuit 43 (Fig. 3) to set the direction of 
the video camera 13a at an initial position ( the pan 
angle = 0 and the tilt angle = 0) (step S33 ) . The 

15 control apparatus 1 supplies a status signal return 
request command (TO) to the video camera 13a via the 
external interface circuit 43 (step S34) and checks if 
initialization is completed (step S35). If NO in step 
S35, flow returns to step S34 to wait for completion of 

20 the initialization; otherwise, the video camera 13a 

returns an initialization end status signal to inform 
to the control apparatus 1 that the video camera 13a is 
operable. The CPU 9 supplies a command for displaying 
a photographed image on the display picture 59 to the 

25 superimposing controller 17 via the bus 8 (step S36), 
and an image photographed by the video camera 13a is 
displayed on the display picture 59 ( step S37 ) . 
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The flow then advances to step S38 in Fig. 21, and 
the zoom lens 49 is moved by controlling the pan 
control motor 40, the tilt control motor 42, and the 
zoom control circuit 50 of the video camera 13a using 
the pan control cursor 61, the tilt control cursor 63, 
and the zoom control cursor 62 until all object persons 
A, B, and C are photographed together by one camera 
picture (step S38). It is then checked if the mouse 15 
clicks the still image trigger key 65 (step S39 ) . If 
NO in step S39, the flow advances to step S42 
(Fig. 22); otherwise, the object persons A, B, and C 
are displayed on the display picture 59, the video 
signal from the video camera 13a at that time is stored 
in the still image storing unit 64, and a command is 
issued to the superimposing controller 17 to read out 
the stored still image and to display the readout still 
image on the still image display picture 66 ( step S40 ) . 
The flow then advances to step S41 to store the 
pan/tilt/zoom positions at that time in the still image 
storing unit 64. 

It is checked in step S42 if the pan control 
cursor 61 is designated. If NO in step S42, the flow 
advances to step S44; otherwise, the moving angle e, in 
the pan direction, of the video camera 13a is 
calculated in correspondence with the absolute position 
of the pan control cursor 61, and an absolute moving 
angle is supplied to the video camera 13a using a U5+ 
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extension to change the angle (step S43 ) . Thereafter, 
the flow jumps to step S48. 

Similarly, it is checked in step S44 if the tilt 
control cursor 63 is designated. If NO in step S44, 
5 the flow advances to step S46; otherwise, the moving 

angle 9, in the tilt direction, of the video camera 13a 
is calculated in correspondence with the absolute 
position of the tilt control cursor 63, and an absolute 
moving angle is supplied to the video camera 13a using 

10 a U6+ extension to change the angle (step S45). 
Thereafter, the flow jumps to step S48. 

Similarly, it is checked in step S46 if the zoom 
control cursor 62 is designated. If NO in step S46, 
the flow returns to step S50; otherwise, the zoom 

15 amount of the video camera 13a is calculated in 

correspondence with the absolute position of the zoom 
control cursor 62, and an absolute zoom value is 
supplied to the video camera 13a using a Z5+ extension 
(step S47 ) . Thereafter, the flow jumps to step S48. 

20 More specifically, the interval between maximum and 

minimum zoom positions is proportionally allocated in 
correspondence with different positions of the zoom 
control cursor 62 . 

In step S48, a status signal return request 

25 command (TO) is sent to the video camera 13a to check 
the execution state of the above-mentioned camera 
operation control command, and it is then checked if a 
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status signal indicating completion of execution of the 
command is returned (step S49 ) . More specifically, the 
control waits for input of a status signal indicating 
completion of execution of the command from the video 
camera, and when execution of the command is completed, 
the flow advances to step S50 (Fig. 23) to check if the 
mouse is clicked in the range of the still image 
display picture 66. If NO in step S50, the flow 
returns to step S39; otherwise, the still image 
position information is read out from the still image 
storing unit 64 (step S51), and a difference between 
the central position of the still image and the 
designated position is calculated by the pointing 
position recognizing circuit 19 (step S52 ) . 

The angle difference from the current camera 
position to the target position is then calculated 
(step S53), and the pan control motor 40 and the tilt 
control motor 42 are driven to move the video camera to 
the target position (step S54). Then, a status signal 
return request command TO is sent to the video camera 
13a (step S55) and it is checked if execution of the 
command is completed (step S56). If NO in step S56, 
the control waits for completion of execution of the 
command; otherwise, the flow returns to step S39 to 
repeat the above-mentioned processing. 

As described above, according to the second 
embodiment, an image photographed by the video camera 
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13a and a still image are simultaneously displayed on 
windows on the monitor 11, and when a required position 
on the still image is designated by the mouse 15, the 
photographing operation of the video camera 13a is 
5 controlled, so that the required position is located at 
the center of the moving image. When the pan control 
cursor 61, the tilt control cursor 63, and the zoom 
control cursor 62 displayed on the display picture 59 
on the monitor 11 are designated and controlled by the 

10 mouse 15, the display control of a video image can be 

attained. For this reason, the load on an operator can 
be reduced by a simple operation, and the photographing 
operation of the video camera can be accurately and 
efficiently performed with a natural feeling while 

15 observing an image displayed on the monitor 11. More 

specifically, an object is photographed at a wide-angle 
zoom position, the photographed image is displayed as a 
still image, and the direction control of the camera 
can be easily realized by operating the mouse in the 

20 picture of the still image displayed on the monitor 11. 

As described above, in the second embodiment, in 
control of the camera having a rotary mechanism portion 
such as a tripod, the direction of the camera can be 
easily controlled to a required object person by 

25 photographing an object at a wide-angle zoom position 

and pointing the position of the required object person 



in the photographed image displayed as a still image on 
the monitor. 

The third embodiment of the present invention will 
be described below with reference to Figs. 24 and 25. 

Fig. 24 is a block diagram showing a control 
apparatus for a video camera according to the third 
embodiment of the present invention. The same 
reference numerals in Fig. 24 denote the same parts as 
in Fig. 1, and a detailed description thereof will be 
omitted. A local terminal and a remote terminal are 
connected via a communication network N such as an ISDN 
line or a LAN line. More specifically, the 
communication network N is connected to the bus 8 of 
the control apparatus 1 via a network connection 
interface 67. A moving image CODEC 68 is connected 
between the bus 8 and the network interface 67, and is 
connected to the video image synthesization circuit: 10 
via a switch 69. A control command transmitted from a 
video camera in the remote station via the 
communication network N is supplied onto the bus 8. On 
the other hand, moving image data transmitted from the 
video camera in the remote station is expanded by the 
moving image CODEC 68, the expanded data is transmitted 
to the image synthesization circuit 10 via the switch 
69, and the video signal is output to the monitor 11. 
Moving image information output from the video camera 
13 in the local station is compressed by the moving 
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image CODEC 68, and is transmitted to the video camera 
in the remote station via the communication network N. 
In this manner, intercommunications can be performed by 
compressing/expanding information on the communication 
5 network to reduce the information amount. 

Fig. 25 shows the operation state and the display 
state of the third embodiment. 

More specifically, the monitor 11 has the still 
image display picture 66, the still image trigger key 

10 65, a local station image display screen 70, and a 

remote station image display screen 71, and the display 
state of the local and remote station image display 
screens 70 and 71 can be controlled on the monitor 11 
by operating the mouse 15 connected to the control 

15 apparatus 1 of the local station. The moving image 
CODEC 68 is detachable from the control apparatus 1, 
and can be attached to a terminal (not shown) provided 
to the back surface side of the control apparatus 1. 
As described above, according to the third 

20 embodiment, a local terminal and a remote terminal are 
connected to each other via the communication network 
N, and each terminal is provided with the control 
apparatus 1 comprising the monitor 11. When the 
control apparatus 1 is controlled by the mouse 15 in at 

25 least one terminal, a local station moving image, and 
moving and still images from the video camera in the 
remote station can be simultaneously displayed on 
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windows on the picture of the monitor 11. in this 
state, when a required pixel position of the still 
image display picture 66 is designated by the mouse 
cursor 15a by operating the mouse 15, the photographing 
5 operation of the video camera 13 can be controlled to 
locate the designated position at the center of the 
picture- In this manner, in the third embodiment as 
well, the load on an operator can be reduced by a 
simple operation, and the photographing operation of 

10 the video camera can be accurately and efficiently 
performed with a natural feeling while observing an 
image displayed on the monitor 11. 

Fig. 26 is a block diagram showing the arrangement 
of a video camera with pan and tilt functions according 

15 to the fourth embodiment of the present invention. 

Referring to Fig. 26, a video circuit portion HOB 
controls a camera head movable portion 11 OA, and 
processes an image signal therefrom. 

The camera head movable portion 11 OA includes a 

20 zoom lens 112, an iris control circuit 114 for 

controlling a light amount, a focus control circuit 116 
for controlling the focusing position of the zoom lens 
112, a zoom control circuit 118 for controlling the 
magnification of the zoom lens 112, an image pickup 

25 element 120 for converting an optical image from the 
zoom lens 112 into electrical signals in units of 
pixels, and a read-out circuit 122 for sequentially 
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reading out the electrical signals from the image 
pickup element 120. 

The camera head movable portion 110A also includes 
a tilt direction drive device 124, comprising, e.g., a 
5 stepping motor and the like, for driving the camera 
head movable portion 110A in the tilt direction, a 
clock generation circuit 126 for generating clocks for 
the image pickup element 120, and a camera head CPU 128 
for controlling the iris control circuit 114, the focus 

10 control circuit 116, and the zoom control circuit 118 
in accordance with a control signal from the video 
circuit portion HOB. 

The video circuit portion HOB includes a pan 
direction drive device 130, comprising, e.g., a 

15 stepping motor and the like, for rotating the camera 

head movable portion 110A in the pan direction, a motor 
drive circuit 132 for controlling the motors in the 
tilt and pan direction drive devices 124 and 130, and a 
process circuit 134 for generating luminance and 

20 chrominance signals on the basis of the output from the 
read-out circuit 122 in the camera head movable portion 
110A. 

The video circuit portion HOB also includes an 
image storing unit 136 for storing all images in a 
25 movable range of the camera head movable portion 110A 
on the basis of the output from the process circuit 
134, a switch 138 for selecting one of the outputs from 
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"the process circuit 134 and the image storing unit 136, 
a video encoder 140 for converting the output from the 
switch 138 into a video signal of a predetermined 
standard, a pointing mark generation circuit 142 for 
5 generating a pointing mark as an arrow or a marker to 
be displayed on the picture, an adder 144 for adding 
the output from the pointing mark generation circuit 
142 to the output from the video encoder 140, and a 
video output terminal 146 for outputting the output 

10 from the adder 144 to an external device. 

The video circuit portion HOB further includes a 
CPU 148 for controlling the entire apparatus, ah I/O 
port 150 for supplying a control signal output from the 
CPU 148 to the respective units, an external interface 

15 152 for interfacing communications between an external 
control device and the CPU 148, a connection terminal 
154 for connecting the external control device, and a 
nonvolatile memory 156 for storing information of a 
photographing prohibition region, and information 

20 inherent to the apparatus* The nonvolatile memory 156 
comprises, e.g., an EEPROM (electrically erasable 
programmable read only memory), a battery-backed up 
D-RAM, an S-RAM (static random access memory), or the 
like. 

25 The video circuit portion HOB also includes 

switches 158 including an all photographing picture 
image display switch 158a, a photographing prohibition 
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setting switch 158b, a left-move switch 158c, a 
right-move switch 158d, an up-move switch 158e, and a 
down-move switch 158f. 

The video circuit portion HOB also includes a 
5 power supply input terminal 160 and a DC-DC converter 
162 for generating a DC voltage required for the 
respective units from a DC voltage input from the power 
supply input terminal 160. 

Fig. 27 is a view showing a state wherein a video 

10 conference is held using this embodiment, and Fig. 28 
shows a display example of the monitor picture. 
Fig. 29 is a perspective view of the drive device in 
the camera head movable portion 110A. Figs. 30, 31, 
32, and 33 are plan views showing the photographing 

15 angles of view at respective pan positions. In this 
embodiment, a horizontal photographable range can be 
covered by four pan operations. Fig. 34 is a side view 
showing movement of a camera 110 in the tilt direction. 
Fig. 35 shows a display example of all photographable 

20 range picture images. 

Fig. 36 is a diagram showing the internal circuit 
of the image storing unit 136. The image storing unit 
136 comprises an image signal input terminal 210, 
control signal input terminals 212, 214, 216, and 218, 

25 a video decoder 220, a filter 222, an A/D converter 

224, a frame memory 226, a D/A converter 228, a filter 
230, an image signal output terminal 232, a sync 
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separation circuit 234, a sync signal generation 
circuit 236, a multifreeze overlap control circuit 238, 
a horizontal frequency dividing circuit 240, a vertical 
frequency dividing circuit 242, a horizontal address 
counter 244, an offset X address buffer 246, an adder 
248 for adding an offset from the offset X address 
buffer 246 to the output address from the horizontal 
address counter 244, a vertical address counter 250, an 
offset Y address buffer 252, and an adder 254 for 
adding an offset from the offset Y address buffer 252 
to the output address from the vertical address counter 
250. 

The operation of this embodiment will be described 
below with reference to Figs. 37, 38, 39, 40, 41, and 
42. The power switch of the camera 110 is turned on 
(S101). The CPU 148 sets the tilt and pan direction 
drive devices 124 and 130 at initial positions via the 
1/0 port 150 and the motor drive circuit 132 (S102). 
The CPU 148 outputs an operation start command to the 
camera head CPU 128 in the camera head movable portion 
110A (S103). 

The camera head CPU 128 controls the iris control 
circuit 114 and a white balance circuit (not shown) to 
adjust the exposure amount and white balance in 
correspondence with an external environment (S104). 
Upon completion of the iris control and white balance 
control, the camera head CPU 128 enables the clock 
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generation circuit 126 to cause the image pickup 
element 120 to start photoelectric conversion. The 
image pickup element 120 converts an optical image from 
the zoom lens 112 into electrical signals. The 
5 read-out circuit 122 sequentially reads out the 

electrical signals from the image pickup element 120 in 
response to the clocks from the clock generation 
circuit 126, and transfers them to the process circuit 
134 (S106). The CPU 148 connects the switch 138 to a 

10 terminal b via the I/O port 150 (S107). When the 
switch 138 is connected to the terminal b, a video 
signal of an object is output from the video output 
terminal 146 to an external device (S108). 

The CPU 148 checks if the all photographing 

15 picture image display switch 158a is depressed (S109). 
When the switch 158a is continuously depressed for 3 
seconds or more (S113), the CPU 148 generates images in 
a photographable range of the video camera 110 by all 
photographing picture image formation processing 

20 (S114). When the all photographing picture image 

display switch 158a is released in less than 3 seconds 
(S113), a flag MODE indicating whether or not an all 
photographing picture image display mode is set is 
checked (S115). If the flag MODE is '0', the all 

25 photographing picture image display mode is set (S116); 
if the flag MODE is ' 0 ? , the all photographing picture 
image display mode is canceled (S123 and S124). 



- 44 - 



Photographing prohibition picture setting 
processing will be described below. It is checked if 
images in a photographable range are already stored in 
the image storing unit 136 (S116). If N (NO) in step 
S116, the flow returns to step S114; otherwise, the 
switch 138 is switched to a terminal a side, so that 
the images stored in the image storing unit 136 are 
output from the video output terminal 146 (S117). It 
is checked if one of the move switches 158c, 158d, 
158e, and 158f is depressed (S118). If N in step S118, 
the flow advances to step S120; otherwise, a 
photographing prohibition setting cursor is displayed, 
and is moved in the designated direction (S119), as 
shown in Fig. 43. The photographing prohibition 
setting cursor is generated by the pointing mark 
generation circuit 142 in accordance with an 
instruction from the CPU 148, and the adder 144 
superimposes the cursor on a video signal of an image 
stored in the image storing unit 136. 

It is checked if the photographing prohibition 
setting switch 158b is depressed (S120). If N in step 
S120, the flow advances to step S122; otherwise, the 
luminance of the pictures which is set in the 
photographing prohibition mode is lowered as compared 
to other pictures free from the photographing 
prohibition mode, as indicated by gray portions in 
Fig. 43 (S121). In Fig. 43, objects A and B are set in 
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the photographing prohibition mode. Thus, the 
photographing prohibition pictures can be confirmed at 
a glance. In addition, the pan and tilt angles of 
image freeze positions and zoom magnification 
information stored in the nonvolatile memory 156 are 
stored in another area in the nonvolatile memory 156 in 
correspondence with the photographing prohibition 
pictures. Thereafter, ' l f is set in the mode 
discrimination flag MODE. 

Fig. 41 is a flow chart showing in detail the all 
photographable picture image formation processing in 
step S114 in Fig. 39. The CPU 148 fetches control 
values ( focal length information f and zoom 
magnification) of the focus control circuit 116 and the 
zoom control circuit 118 from the camera head CPU 128 
via the I/O port 150, and calculates horizontal and 
vertical photographable angles Wp and Wt of view of the 
image pickup element 120 at that time using the 
following equations by a method in Fig. 44, which is 
the same as that in Fig. 7 in the first embodiment 
(S131). 

X/2f = tan(Wp/2) ...(4) 
Y/2f = tan(Wt/2) ...(5) 
where X is the horizontal effective image size of the 
image pickup element 120, and Y is the vertical 
effective image size. 
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Then, divided image numbers Np and Nt in the pan 
and tilt directions of multi-pictures in the image 
storing unit 136 are calculated (S132). If the movable 
angle, in the pan direction, of the camera 110 is 
5 represented by Qpmax and the movable angle, in the tilt 
direction, thereof is represented by etmax, the numbers 
Np and Nt are respectively given by: 

Np = [Bpmax/Wp] . . . ( 6 ) 

Nt = [etmax/Wt] .-.(7) 
10 where [X] is an integer equal to or smaller than X + 1 
and larger than X. If the current position of the pan 
angle is represented by 0p and the current position of 
the tilt angle is represented by et, the camera head 
movable portion 110A is moved and set to attain Gp = 0 
15 and Gt = 0 (S132). Note that Gp = 0 corresponds to the 
state shown in Fig. 30, and Gt = 0 corresponds to a 
position a in Fig. 34. 

Freeze counters CNfp and CNft in the pan and tilt 
directions are initialized (S133). That is, 
20 CNfp =0 . . . ( 8 ) 

CNft = 0 . . . ( g ) 

The value of the freeze position is set in the 
offset X and Y address buffers 246 and 252 of the image 
storing unit 136 (S134). The CPU 148 instructs the 
25 sync signal generation circuit 236 in the image storing 
unit 136 via the 1/0 port 150 to output an image freeze 
timing signal. The CPU 148 stores the pan angle Gp, 
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the tilt angle Gt, and the zoom position information in 
the image freeze state in the nonvolatile memory 156, 
and utilizes these information in control of the 
photographing prohibition range in a normal camera 
5 control mode (S135). 

The pan direction counter CNfp is incremented 
(S136). An image is rotated by Gpmax/Np in the pan 
direction, and is frozen at a position given by (S137): 
Gp = Gp + epmax/Np ...(10) 

10 The count of the pan direction counter CNfp is 

compared with the multi-picture image number Np in the 
pan direction to check if the image freeze operation in 
the pan direction is completed (S138). If N in step 
S138, the flow returns to step S134 to repeat step S134 

15 and subsequent steps (see Figs. 31 and 32). 

Upon completion of fetching of an image in the pan 
direction (see Fig. 33), the tilt direction counter 
CNft is incremented (S139), and the camera head movable 
portion 110A is directed to a position of the pan 

20 direction angle Gp = 0 (S140). An image is rotated by 
Gtmax/Nt in the tilt direction (S141). Please refer to 
a position b in Fig. 34. 

The count of the tilt direction counter CNft is 
compared with the multi -picture image number Nt in the 

25 tilt direction to check if the image freeze operation 
in the tilt direction is completed (S142). If N in 
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step S142, the flow returns to step S134 to repeat step 
S134 and subsequent steps. 

With the above-mentioned operation, all 
photographable ranges of the camera 110 are 
5 photographed in turn to form images of all 

photographable pictures. Fig. 35 shows an example of 
all the completed photographable picture images. In 
this case, four pictures in the horizontal direction 
and three pictures in the vertical direction are used. 

10 However, the present invention is not limited to these 
numbers of pictures. 

Fig. 42 is a flow chart showing in detail the 
processing in step S112 in Fig. 38. Upon operation of 
the move switch 158c, 158d, 158e, or 158f (or in 

15 response to a similar operation command from an 

external device), the camera head movable portion 110A 
is moved in the pan and tilt direction to update the 
pan angle Bp and the tilt angle 6t (S151). The 
photographing prohibition range information is read out 

20 from the nonvolatile memory (S152). When the focal 
length has been changed due to a change in zoom 
magnification (S153), the photographing prohibition 
range information read out from the nonvolatile memory 
156 is corrected in correspondence with the change in 

25 focal length (S154). If the current pan and tilt 

angles fall outside the photographing prohibition range 
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(S155), a video output operation is permitted; 
otherwise, the video output operation is prohibited. 

For example, as shown in Fig. 45, a 3- terminal 
switch 139 is arranged in place of the switch 138, and 
5 the output from an image storing unit 137 for storing a 
still image is connected to a terminal c of the switch 
139. If the current pan and tilt angles fall outside 
the photographing prohibition range (S155), the switch 
139 is connected to a terminal b to video-output a 

10 photographed image (S156); otherwise, the switch 139 is 
connected to the terminal c to video-output a still 
image stored in the image storing unit 137 (S157). 

Fig. 46 shows a video image superimposing circuit 
connected to the bus of a personal computer or 

15 workstation, and this circuit can have a function of 

the image storing unit 136 shown in Fig. 36. With this 
circuit, the camera 110 need only have a function of 
outputting a photographed image. 

Referring to Fig. 46, an input terminal 300 

20 receives an analog video signal complying with the 

NTSC/ PAL/SECAM system. An A/D converter 302 converts 
an analog video signal from the input terminal 300 into 
a digital signal. A digital video decoder 304 converts 
the output from the A/D converter 302 into RGB signals, 

25 and supplies the RGB signals to a mirror image 

conversion circuit 305. In accordance with an external 
control signal, the mirror image conversion circuit 305 
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supplies the outputs from the decoder 304 to a 
synthesization control circuit 306 with or without 
reversal in the horizontal direction. A PLL circuit 
308 supplies clocks of a predetermined frequency to the 
A/D converter 302, the video decoder 304, the mirror 
image conversion circuit 305, and the synthesization 
control circuit 306. 

Data on a bus 310 of the personal computer or 
workstation is supplied to the synthesization control 
circuit 306 via a buffer 312, and address/control 
signals are directly supplied to the synthesization 
control circuit 306. Also, the data and 
address/control signals on the bus 310 are also 
supplied to a VGA display signal generation circuit 316 
via a bus interface 314. The VGA display signal 
generation circuit 316 generates VGA image data of an 
image stored in a memory 320 in accordance with a 
timing signal from a display timing generation circuit 
318. The generated image data is supplied to the 
synthesization control circuit 306 and a color palette 
322. The color palette 322 outputs RGB image data in 
accordance with data from the circuit 316. 

The synthesization control circuit 306 writes the 
RGB data from the video decoder 304 in a video memory 
324, and generates a switching control signal of a 
switch circuit 326 in accordance with the 
address/control signals form the bus 310. The switch 
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circuit 326 selects the RGB outputs from the color 
palette 322 or the RGB data from the video memory 324 
in accordance with the switching control signal, and 
outputs selected data to a D/A converter 328. The D/A 
5 converter 328 converts digital data into an analog 
signal. An image signal which is synthesized as 
described above is supplied to a monitor 132 via an 
output terminal 330 , and is displayed on a picture 134. 
In the all photographable picture image formation 

10 mode, the synthesization control circuit 306 stores 

images of video signals input to the input terminal 300 
in an all photographing range images memory 325. More 
specifically, the all photographing range images memory 
325 has the same function as the image storing unit 

15 136. When all photographable picture images stored in 
the all photographing range images memory 325 are to be 
output, the synthesization control circuit 306 
sequentially reads out image data stored in the memory 
325, and transfers them to the switch 326 via the VRAM 

20 324. In this manner, the same function as the image 

storing unit 136 and the switch 138 can be realized by 
the circuit shown in Fig. 46. 

In the example shown in Fig. 43, the multifreeze 
overlap control circuit 238 in Fig. 36 can eliminate 

25 boundaries among images. Fig. 47 shows an image 
without boundaries . 



- 52 - 



Fig. 48 shows the transmission format of control 
commands for externally controlling the camera 110. 
The CPU 148 performs iris, focus, zoom, pan, and tilt 
control in accordance with the control commands in the 
format shown in Fig. 48. The control command consists 
of an identifier ( " : " in this case), information of an 
apparatus to be controlled (3 bytes), the kind of 
operation command (2 bytes), an extension flag, and the 
like. 

The present invention is not limited to the above 
embodiments, and various changes and modifications may 
be made within the spirit and scope of the invention. 
In each of the above embodiments, an image position is 
designated using a mouse but may be designated using a 
combination of a digitizer and an input pen. In each 
of the above embodiments, the moving angle to a target 
object may be calculated at high speed by a 
special-purpose circuit. 



